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INTRODUCTION 

Understanding thermodynamics of irreversible pro- 
cesses from time reversible microscopic dynamics has 
been a subject of great interest since the time of founda- 
tion of statistical physics. A fair amount of progress has 
been made since then, especially through the recently 
discovered fluctuation theorems [iJ-Q. The fluctuation 
theorems give a quantitative measure of irreversibility 
in terms of asymmetries in the probability distributions 
of various quantities in a driven system, e.g., heat pro- 
duced in a sheared fluid [H-[3l , heat exchanged between a 
hot and a cold body being in contact @, H|, etc. These 
nonequilibrium quantities, usually termed as 'entropy 
production' in an irreversible process are on av- 

erage non-negative and give an insight into the 2nd law 
of thermodynamics. The fluctuation theorem was orig- 
inally derived for deterministic thermostatted dynamics 
3 and later for stochastic one, such as Langevin dynam- 
ics Q and Markovian jump processes [lfjj . 

Closely connected to the fluctuation theorems, there 
are two remarkable relations, called the Jarzynski equal- 
ity l44l6j and the Crooks theorem 17|, which involve 
fluctuation of work done on a system driven arbitrarily 
far away from equilibrium by varying an external parame- 
ter. Consider a system which is initially at an equilibrium 
state A at temperature T and coupled to an external pa- 
rameter X(t). The system is driven out of equilibrium by 
varying A(i) in a time interval < t < r where \(t) is 
constant outside this time interval. In this process, called 
forward process for a fixed protocol A(t), an amount of 
work W is done on the system. The system eventually 
relaxes to an equilibrium state B at same temperature 
T. In the reverse process, the system is driven from the 
initial equilibrium state B for a reverse protocol A(t — t) 
and eventually the system relaxes to the equilibrium state 
A. The Jarzynski equality relates average of exp(— (3W) 
performed over nonequlibrium trajectories to equilibrium 
free energy difference AF = F(B) — F(A) as 



where F(A) and F (B) are equilibrium free energy of the 
system at state A and B respectively, and (3 = 1/ fc^T, Ub 
the Boltzmann constant. The Crooks theorem relates the 
ratio of the probabilities of work done W for the forward 
process and that for the reverse process, 



Pf(W) 



a P(W-AF) 



(exp(-/3W)) = exp(-/3AF) 



(1) 



Pr(-W) ~ (2) 

where PpiW) and Pr{W) are the probability distribu- 
tions of work for the forward and the reverse processes, 
respectively. 

Dissipative mechanism of a heat bath is crucial for un- 
derstanding irreversible phenomena and the fluctuation 
theorems [l8( , and is modeled in various ways, such as, by 
employing deterministic thermostatted dynamics [H, 
stochastic Langevin dynamics satisfying the fluctuation- 
dissipation theorem [il, T^- 21 1 or Markov dynamics sat- 
isfying detailed balance with respect to canonical mea- 
sure [IT], H3|- However in these cases, the heat bath is 
not considered explicitly, and is assumed to be always 
in equilibrium. In a realistic scenario, heat generated 
by a driving force is continuously dissipated to the heat 
bath, and consequently the portion of the heat bath in 
the vicinity of the system goes away from equilibrium 
during driving [23|, [24 1 . 

It is therefore important how one employs a heat bath 
to take into account the nonequilibrium effect of the 
bath. Recently there is a prescription of modeling a 
driven system, possibly in contact with a nonequilib- 
rium heat bath, by applying Jaynes' principle of entropy- 
maximization [25[ to nonequilibrium trajectories with a 
macroscopic flux constraint piiU^ . However we follow a 
different path where we explicitly consider a system and 
a heat bath combined, either obeying microscopic New- 
tonian dynamics or obeying stochastic dynamics with 
symmetries of the microscopic Newtonian dynamics pre- 
served. The work fluctuation relations have been stud- 
ied along this line before for classical Hamiltonian dy- 
namics [Hi, |30l as well as stochastic dynamics [3l| , but 
any time-reversal symmetry-breaking fields or noncon- 
servative forces have not been considered. Recently, the 
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fluctuation theorem involving particle-current has been 
studied in a case of quantum mechanical transport of 
electrons across a quantum dot in the presence of a time- 
independent magnetic field [32I ]. 

In this paper, we generalize the fluctuation theorems 
for classical systems in the presence of a time-reversal 
symmetry-breaking field, such as an external magnetic 
field, and nonconservative forces which cannot be derived 
from gradient of scalar potentials. We consider a system 
and a heat bath, combined, in a deterministic as well as a 
stochastic set up and we show that the fluctuation theo- 
rems are valid in the presence of time- reversal symmetry- 
breaking fields and nonconservative forces, even when the 
heat bath goes out of equilibrium during the driving. The 
validity only requires that (1) in the absence of driving 
the system and the heat bath, combined, relax to a state 
with a uniform probability measure on a constant en- 
ergy surface, and (2) there exists a time-reversal opera- 
tion under which work performed on the system is odd. 
Although we specifically consider an external magnetic 
field in the paper, the results are also applicable to other 
time-reversal symmetry-breaking fields, e.g., a Coriolis 
force present in a rotating system. 

In a deterministic set up, we consider a system obeying 
Newtonian dynamics and we prove the fluctuation theo- 
rems using the fact that Liouville's theorem is valid even 
in the presence of an external time-dependent magnetic 
field as well as other nonconservative forces. We also ex- 
tend our analysis to stochastic dynamics in the presence 
of a time-reversal symmetry-breaking field in a micro- 
canonical set up. We consider an isolated system gov- 
erned by Markovian dynamics where there is violation of 
detailed balance with respect to a uniform measure, i.e., 
forward and corresponding reverse transition probabili- 
ties are not equal in general. Reversing the time-reversal 
symmetry-breaking field results in dynamics where all 
forward and corresponding reverse transition probabili- 
ties are interchanged with each other. Although detailed 
balance is violated, we prove the fluctuation theorems 
only requiring that the steady state measure of an iso- 
lated system is uniform on a constant energy surface. 

We primarily focus on the work fluctuation relations, 
i.e., the Jarzynski equality and the Crooks fluctuation 
theorem. The system is driven by varying a control pa- 
rameter of an external potential or (and) by nonconser- 
vative forces. For systems obeying Newtonian dynam- 
ics, the driving force may be due to a nonconservative 
electric field induced by an external time varying mag- 
netic field in addition to other nonconservative forces. 
The work fluctuation theorems have recently been stud- 
ied for a few specific cases of a single Brownian particle 



in the presence of both time-independent (33l |34| and 
time-dependent [35| magnetic field. However we formu- 
late the problem in a more general setting, taking into 
account the system and the heat bath degrees of freedom 
explicitly. Note that our analysis is applicable only to 



the classical systems consisting of particles which do not 
have any intrinsic magnetic moment. 

Here is a brief outline of the paper. In section II, we 
study systems obeying Newtonian dynamics in the pres- 
ence of an external magnetic field and some other non- 
conservative force fields. In section III, we give a general 
proof of the fluctuation theorems for stochastic systems 
in the absence of detailed balance in a microcanonical set 
up, in section IV we then illustrate the ideas using two 
simple stochastic models. In section V, we generalize the 
results for other intensive thermodynamic variables, e.g., 
pressure and chemical potential which determine the ini- 
tial and final equilibrium states of the system in contact 
with a heat bath. 



NEWTONIAN DYNAMICS 

First, we study the noncquilibrium fluctuation theo- 
rems in a general deterministic framework for a system 
and a heat bath combined, called the combined system 
(CS). We consider the CS, which is governed by micro- 
scopic Newtonian dynamics, in the presence of an ex- 
ternal magnetic field B(f,t) and a nonconservative force 
field f(f,t). Force fields in general may be dependent 
both on position f and time t. The nonconservative force 
f(f, t) cannot be derived from gradient of a scalar po- 
tential. In addition, there may be conservative forces 
present in the CS which can be derivable from gradient 
of scalar potentials. A microstate of the CS is denoted 
by a variable Y which contains positions and velocities 
of all particles, i.e., Y = (fi, r 2 , ■ ■ ■ , «i, v 2 , ■ ■ ■ ) = {n,Vi} 
where f and Vi are position and velocity of z-th particle 
in the CS respectively. Newton's equations of motion for 
i-th particle can be written as 



rriiVi 



■Vp t V(?i,\{t)) + qiVi x B(fi,t) 

dl{n,t) 



Of 



+ f(n,t) 



(3) 



(4) 



where m; and Qi are mass and charge of the i-th particle, 
V(f, A(i)) is total scalar potential at position f due to the 
inter-particle interaction potentials as well as an external 
potential with a time-dependent control parameter X(t), 
Vf 4 the gradient operator with respect to coordinate fi, 
A(f, t) is the vector potential at position f and time t 
due to the external magnetic field B(f,i) which can be 
written as curl of the vector potential, i.e., B(f,t) = 
V x A(f,t). The third term in the r.h.s. of Eq. [4] is due 
to the time varying magnetic field B(f,t) which induces 
a nonconservative electric field, —dA/dt. The induced 
electric field, like f(f,t), cannot be derived from gradient 
of a scalar potential. 

It is important to note that, when the nonconserva- 
tive force field f(f,t) is present, there is no Hamiltonian 
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for the CS and consequently Eqs. [3j [4] cannot be de- 
rived using a familiar Hamiltonian prescription of classi- 
cal mechanics (H)]. However the microscopic Newtonian 
equations of motion are still invariant under time-reversal 
with the direction of the magnetic field also reversed, 
i.e., as t — > —t, Hi — > —Vi and B(r) — > —B(r) (equiva- 
lently A(r) — > —A(r)), Eqs. |3] and |4] remain unchanged. 
Therefore, for any trajectory Y(t) = {ri(t),Vi(t)} with 
a fixed protocol {X(t), B(r, i), f(r, t)} in a time range 
— T < t < T, there exists a reverse trajectory Y(t) = 
{r\(— t), — Vi(— t)} for the corresponding reverse proto- 
col {A(-i), -B(r, -t), /(r, -t)}. Note that in the time- 
reversal operation mentioned above, direction of the non- 
conservative forces, / as well as —dA/dt, are unchanged. 

In the subsequent discussions, we consider a process 
in a time interval —T<t<T where T is very large 
compared to any other time scales. We assume that the 
magnetic field B(r,t), the external parameter X(t) and 
the nonconservative force field f(r,t) couple only to the 
system. The field B(f,t) (or equivalcntly the vector po- 
tential A(f 7 1)), X(t) and f(r 7 t) are varied according to 
a fixed protocol only in time interval < t < r where 
t ^ T ■ Otherwise B, X are kept constant and / = 
outside the interval < t < r. 

Although there is no Hamiltonian in the presence of 
nonconservative forces, energy function of the CS, in 
terms of positions and velocities, can be defined as 

E({n,vi}) = r>2 \ m ^Vj + V({n},\m (5) 

where the first term is the total kinetic energy and the 
second term V ({fi} , X(t)) is the total potential energy, 
containing both the interaction pair-potentials dependent 
on relative position \ri — fj | between any pair of particles 
i, j and an external potential with a control parameter A. 
The total energy of the CS, defined in terms of positions 
and velocities, does not depend on the external magnetic 
field. However a time varying magnetic field does change 
the energy of the CS because of the work performed by an 
induced nonconservative electric field dA(r"i,t)/dt. This 
can be seen as following: Using Eqs. |3l 21 the rate of 
change of total energy E of the CS can be written as 

d 



since (dE/dt) = outside the time interval < t < r. 
The rate of change of energy is clearly odd under time- 
reversal, i.e., (dE/dt) — > —(dE/dt) asf^ —t, — > — 
and A —A because (dA/dt) is even and dX/dt is 
odd under time-reversal. In other words, total work per- 
formed equals to the difference in total energy between 
the final and the initial point of a trajectory and there- 
fore total work is odd under time- reversal, VVf[Y(£)] = 
-W R [Y(t)]. 

Let us now consider time evolution of phase space den- 
sity p(Y) at a phase space point Y = {ri,^}. From the 
equation of continuity, one obtains that the rate of change 
of phase space density p(Y) equals to the divergence of 
local phase space current density pY, i.e., one gets the 
local conservation equation [36| 



(8) 



where we have denoted the divergence of the phase 
space current as d(pY)/dY = J2i fii^iP^i^)/^' 



d(pvi,p) / dvi^p] where and v^p are /3-th Cartesian 
component ((3 = 1, 2, 3 in three dimension) of the position 
vector Ti and the velocity vector Vi respectively. Taking 
derivative explicitly with respect to the phase space point 
Y, Eq. [5] can be rewritten as 



dp 
dt 



dp\ 
dYj 



dY 
'dY 



0. 



(9) 



dt 



v i .J r i + (dV/dX)X, (6) 



where Y.(dp/dY) = Y. % p-\ i 'iA d Pl dr i,p) + 
i>i,i3(dp/dvi y p)) and the phase space compression 
factor dY/dY = J2i,p [(ph,p/dr it p) + {dv^p / dv it p)\. 
Since the r.h.s. of Eq. [3] is independent of n, taking 
partial derivative of Eq. [3] with respect to the position 
coordinate, one gets (dri t p / dr^p) = 0. Note that the 2nd 
term in the r.h.s. of Eq. U depends on Vi only through 
the cross product with the external magnetic field vector 
B and therefore partial derivative d(vi x B)p/dv^p = 
where (vi x B)p denotes /3-th Cartesian component of 
the vector (vi x B). Since all other terms in the r.h.s. 
of Eq. [4] are independent of Vi, taking derivative of 
Eq. 2]with respect to the velocity coordinates, one gets 
(di>i t p / dvi t p) = 0. This implies that the phase space 
compression factor dY/dY = 0, and therefore, from Eq. 
[51 one arrives at Liouville's theorem, 



where Ti = \— qidA(r*i, t)/dt+f(fi,t)] is sum of all the ex- 
ternal nonconservative forces acting on i-th particle of the 
CS. This implies that the rate of change of total energy 
of the CS equals to the rate of work W done by all the 
external forces on the system, i.e., (dE/dt) = (dW/dt). 
Total work W performed on the system can be calculated 



as W = J^ r (dE/dt)dt, or 



W 



dE\ 

-dT ]dt 



(7) 



dp 
~dt 



dp 
dt 



Y. 



dp_ 
dY 



= 0. 



(10) 



The above equation is an important statement which says 
that, even in the presence of a time-dependent external 
magnetic field and other time-dependent nonconservative 
forces, a set of phase space points flow like an incom- 
pressible fluid under microscopic Newtonian time evolu- 
tion equations. Given that the phase space is incom- 
pressible, the CS at t = ±T, with / = = -(dA/dt) 
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and A = constant, can be considered to have a uniform 
(microcanonical) measure on a constant energy surface, 
E(Y, A) = constant. 

One can now prove the Crooks theorem by using Li- 
ouville's theorem that the phase space is incompress- 
ible and the property that total work performed on 
the CS is odd under simultaneous reversal of time 
and the magnetic field. Let us denote the probabil- 
ity distributions of work W, P{W;a{t)) = P F {W) and 
P(W;a(t)) = Pr(W), respectively for a forward proto- 
col a(t) = {X(t), f(r,t), B(t)} and corresponding reverse 
protocol a(t) = {X(-t), f(f,-t),-B(-t)}. Nowfollow- 
ing the arguments along the line of Rcf. 
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consider a set A of initial phase space points at time 
t = —1~ which evolve from a constant energy surface 
with energy £ to a set of points A' of the final phase 
space points of a constant energy surface with energy 
E + W at time t = T for driving under the forward pro- 
tocol a(t). Total work performed on the system in this 
process is W and the probability distribution of work 
Pf(W) = cj(A)/Q(E) where oj(A) is the phase space 
volume of the set A and O(P) is the phase space volume 
of the constant energy surface with total energy E. Now 
for any trajectory with the forward protocol a(t), there 
exists a unique time reversed trajectory with the reverse 
protocol 6t(t), and work performed along a time reversed 
trajectory, initially starting from one of the set of phase 
space points A' R obtained by velocity-reversal of the set 
A 1 , is negative of the work performed for the correspond- 
ing forward trajectory. Therefore, for the reverse trajec- 
tories, the phase space transforms from the energy sur- 
face with energy E + W to an energy surface with energy 
E. Then, the probability distribution Pr(— W) can be 
written as Pr{-W) = cj{A' r )/Q(E + W). Now using Li- 
ouvillc's theorem that phase space is incompressible, we 
have u>(A) = ui(A'), and then using uj(A') = lo(A' r ) that 
phase space volume does not change under reversal of ve- 
locities, one obtains the ratio of the probabilities of work 
W and -W as P F (W)/P R (-W) = Vl{E + W)/Q(E). 
The ratio can also be written as 



P F (W) _P st (Y(-T),X(Q)) 



Pr{-W) P 5t (Y(T),A(r)) 



(11) 



where P at (Y, A) = 1/Q(E(Y, A)) is the initial or the final 
equilibrium probability distribution of the CS. Note that 
P s t(Y, A) is independent of the external magnetic field B 
as the total energy E given in Eq. [5j and therefore £l(E), 
does not depend on B. 

At this point one can separate the system from the 
heat bath by defining entropy and temperature of the 
CS which has a uniform probability measure on a con- 
stant energy surface. The probability P st (Y, A) of a mi- 
crostate of the CS, at t = ±T, is inverse of phase space 
volume Q(E) of a constant energy surface with energy 
E, i.e., P s t = l/f2 = cxp(— S/ks) where S is defined as 



entropy. We set the Boltzmann constant ks — 1 after- 
wards. Partitioning the CS into two parts, the system 
and the heat bath with energies e and (E — e) respec- 
tively, one can write P st (Y, A) = [/ e s B (E-e)+s(e,\) df ^ - 1 
where Sb(E — e) and S(e, A) are entropy of the heat bath 
and the system respectively. We have here assumed the 
interaction energy between the system and the bath to 
be much smaller than energy of either the system or the 
bath. Now introducing inverse temperature (3 of the heat 
bath, (3 = 8Sb (E) / BE and expanding Sb (E — e) in lead- 
ing order of e/E, S B (E - e) = S B {E) - /3e + 0(e/E) 
in the limit e < E, one gets P st (E,X) = e -s B (E) e i3F{\) 
where the Hclmholtz free energy of the system F(X) = 
— In [J e~^e s( - e '^de] with density of states 

of the system with energy e. 

From conservation of energy, we have E(T) = 
[E(-T) + W] where E{-T) = P(Y(-T),A ), 
E(T) = E(Y(T),X T ) and W is total work per- 
formed for the forward protocol. Writing proba- 
bilities of the initial and final microstates respec- 
tively as P 3t (Y(-T), X ) = e -s B (E(-T)) e PF(x m and 
P st (Y(T),A(r)) - e s B (E(-T)) e -pw e f)F(HT)) : one gets 
the ratio of probabilities of the final and initial equilib- 
rium microstates of the CS as 



P af (Y(-T),A(0)) 
P st (Y(T),A(r)) 



_ B(W-AF) 



(12) 



where (3 is inverse equilibrium tempera- 
ture of the heat bath. Note that, writing 
P st (Y(-T),A(0))/P st (Y(T),A(T)) = cxp(A5 C 5) in 
the l.h.s of Eq. [12l one obtains the thermodynamic 
relation TAScs — W — AF where AScs is change 
in total entropy Scs of the CS, AF is change in free 
energy of only the system and temperature T = 1//3 f3?| . 
Now substituting the above ratio of the probabilities 
into Eq. [ITJ one obtains the Crooks theorem in the 
presence of a time-dependent external magnetic field 
and a nonconservative force, 



P(W;X(t),B(t)) 
P(-W;X(-t),-B(-t)) 



_ B(W-AF) 



(13) 



The Jarzynski equality (exp(— (3W)) = exp(— 0AF) fol- 
lows by integrating the Crooks theorem [17J . 

The Crooks theorem has a simpler form when A is kept 
constant (implying AF = 0) , / = throughout and only 
the magnetic field B(t) varies in a time-symmetric cycle 
where B{t) = B(t — t) with initial and final values of 
B = 0. Consider an electrical circuit which is symmet- 
ric with respect to B(t), e.g., see Fig. [1] where a ring 
is placed in an uniform time-dependent magnetic field in 
the direction perpendicular to the ring. The time vary- 
ing magnetic field induces an oscillating electric field and 
an electric current in the circuit. For any finite number 
of such cycles, the induced electric field —dA/dt per- 
forms work W on the system and thus generates heat 
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Time dependent magnetic field 
B=Curl A(r,t) 




A(r, t) 



t=x 



FIG. 1: Electric current flows in a ring due to a time- 
dependent magnetic field B(f, f) = Vx A{f, t), perpendicular 
to the ring, where the vector potential A(r, t) at position r 
varies with time t. 



in the circuit. In this case, due to the geometric sym- 
metry, the probability distribution of work is same for 
B{f) and —B(t) and only depends on the magnitude of 
B, i.e., P F {W) = P R {W) = P(W; \B\). Since B varies in 
time-symmetric cycle, one finally arrives at the Crooks 
theorem P{W; \B\)/P(-W; \B\) = exp{/3W) which gives 
an estimate of irreversibility of the heat produced in an 
alternating electric current-carrying circuit. 

The fluctuation theorems can be similarly extended to 
the cases where there are a Coriolis force 2m{Co x v) and a 
centrifugal force mw x {Co x r) acting on a particle of mass 



|, Co being angular velocity of the rotating system, 
in addition to an external magnetic field. The fluctuation 
theorems are still valid provided that one reverses the di- 
rection of the angular velocity Co as well as the magnetic 
field B. This is because even if one adds the centrifu- 
gal and Coriolis forces in Eq. |4] the phase space is still 
incompressible, i.e., dY /dY = 0. 



STOCHASTIC DYNAMICS 

In this section, we consider a system and a heat 
bath combined (CS), in a general stochastic framework. 
Stochasticity may arise due to incomplete knowledge of 
some of the degrees of freedom in the original deter- 
ministic system Due to incomplete knowledge of 
the degrees of freedom, a system is described by some 
coarse-grained variables and is governed by a stochastic 
dynamics. We consider a Markovian dynamics of the CS, 
specified by transition probability w{Y'\Y)dY' , from a 
configuration Y at time t to any configuration in the vol- 
ume element dY' around Y' at time t + At, where the 
degrees of freedom of the CS are denoted as Y{t) at time 
t. Transitions are allowed on a constant energy surface of 
the CS. In subsequent discussion, we consider a class of 
models where, in the absence of driving, a uniform (mi- 
crocanonical) measure is realized on a constant energy 
surface of the isolated CS. 



Transition probabilities are chosen so that they obey 
symmetries and conservation laws of underlying mi- 
croscopic dynamics. The degrees of freedom Y(t) = 
{Y + ,Y_} may be identified as two sets of stochastic 
variables, Y + (e.g., position) and Y_ (e.g., velocity), and 
there exists a Ye {Y + , — Y_} for any given Y. In the 
presence of a time-reversal symmetry-breaking field, such 
as an external magnetic field B, we impose a condition 
on the transition probabilities as given below, 



w{Y'\Y;B) =w{Y\Y';-B) 



(14) 



The above condition can be taken as definition of a 
magnetic field in a stochastic set up where reversing 
the magnetic field results in interchanging forward and 
corresponding reverse transition probabilities with each 
other. Indeed, under suitable assumptions, the tran- 
sition probabilities chosen above can be derived for a 
closed isolated classical system governed by a micro- 
scopic Newtonian dynamics [3{| H(| • Note that Eq. [14] 
equates transition probabilities of two different systems, 
one with a magnetic field B and the other with a mag- 
netic field —B. Time-reversal of a trajectory Y{t), in 
a symmetric time range — T < t < T , is defined as 
Y(t) - Y(-t) = {Y+(-t),-Y_(-t)} when t -t. 
The variables Y and Y transform to each other under 
time-reversal where time-reversal operation is ensured by 
the condition in Eq. [14] 

In the absence of a magnetic field, Eq. [TJ] (with 
B = 0) implies extended detailed balance condition 
to(Y'|Y) = w(Y\Y'). When Y = {Y+} contains only 
position-like variables, Eq. [T4l becomes iu(Y + |Y' + ; B) = 
u;(Y / _|_|Y_|_; —B) which, for B = 0, implies the condition 
of detailed balance w{Y + \Y' + ) = w(Y'+|Y+) j^. 

Note that, under the condition of Eq. [14] an isolated 
CS in general does not satisfy detailed balance. To stress 
the violation of detailed balance, later in section III. A, 
we would specifically consider a case where the reverse 
transition is not allowed and any reverse transition prob- 
ability corresponding to a forward one is set to be zero. 

However choice of the transition probabilities cannot 
be arbitrary and one has to put some constraints so that 
(a) all the states are connected to each other ensuring 
the Markov process is ergodic, and (b) steady state con- 
figurations are all equally probable. In this paper, we 
consider a class of stochastic models which satisfy con- 
straints (a) and (b). For a network of discrete states 
in a configuration space, a sufficient condition for such 
a class, which we call loopwise balance condition, can 
easily be formulated (see appendix for details). Even 
if the CS relaxes to a state having a uniform measure, 
the state would be a nonequilibrium steady state due to 
the violation of detailed balance. It is important to note 
that, provided there exists a unique and uniform steady 
state measure p{Y) = constant for a Markov process 
with a magnetic field B, the Markov process with the re- 
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verse magnetic field — B is well defined, i.e., the transition 
probabilities are still normalized J dY'w(Y'\Y; — B) = 1, 
and the same steady state measure p(Y) = constant is 
guaranteed for the Markov process with — B. In other 
words, J dYw(Y'\Y;B)p(Y) = p(Y') = constant 
J dY'w{Y\Y';-B)p(Y') = p(Y) = constant, i.e., uni- 
form steady state measure is invariant under reversal of 
the magnetic field. This is because the normalization 
condition j dY'w(Y'\Y; B) = 1 implies the steady state 
condition J dY'w(Y\Y' ; — B) = 1, which can be shown 
by using Eq. Upland the transformation Y — > Y. This is 
discussed and illustrated in the appendix. 

We stress that the assumption of Markovian dynamics 
of a system and a heat bath, combined, is weaker than 
that of Markovian dynamics of only the system. Even 
if the combined system obeys Markovian dynamics, dy- 
namics of the system, in lower dimensional configuration 
space, is non- Markovian, in contrast to the system con- 
sidered in Ref. [22|. 

The total energy of the CS is denoted as E(Y, A) where 
A is an external parameter coupled only to the system. 
When the CS is not driven, E(Y, A) is conserved. Im- 
portantly, total energy E depends explicitly only on Y 
and A, not on the magnetic field B [41| and it is an even 
function of Y so that E(Y, A) = E(Y, A). For simplic- 
ity we assume time t changes in discrete step of At and 
we consider a Markov chain in a time range — T < t < T 
where T is very large. The parameter A is changed from 
A = Ao to A = A T according to a deterministic protocol 
in a finite time interval < t < r where t <^ T and 
otherwise kept constant. We call it a forward protocol. 
A reverse protocol is defined as {A t } = {A_ t }. 

An amount of work SWt at time step t may be per- 
formed on the system in two ways. One may usually 
change the external parameter from At to At + S At, keep- 
ing Y fixed, and the work performed is 5W t — E(Y t , X t + 
SX t ) — E(Y t , A t ). Now we introduce here the second way 
of performing work on the system. One may also change 
the degrees of freedom of the CS, at a time step t, deter- 
ministically from Y t to Y' t = S At (Y t ), keeping A fixed, 
where S is a time-reversal symmetric evolution opera- 
tor, i.e., if Y — > Y' under influence of a nonconservative 
force, Y' — > Y under influence of the same force. For ex- 
ample, S may simply be the Newtonian time evolution 
operator. We will illustrate this by using a simple model 
in section IV. B. Work performed in this case is calculated 
as SW t = E{Y t + SY t , A t ) - E{Y t , A t ) which is the work 
performed by a nonconservative force when the evolu- 
tion operator S t contains such a force. The total work 
W performed on the system is written as W = J^t $Wt- 

A trajectory is denoted by {Y t , A t , B} where Yt, At are 
respective values of Y, A at time t and B is the external 
magnetic field. Given a trajectory {Y t ,At,-B}, there is 
a unique reverse trajectory {Y t ,Xt,—B} with reversed 
magnetic field — B and reverse protocol {At}. Note that 



the trajectory {Y t , At, B}, without reversing B, may not 
even be realizable if some of the reverse transition prob- 
abilities arc zero. From Eq. [TU the probabilities of 
a trajectory from a given initial configuration with the 
magnetic field B and that of the corresponding reverse 
trajectory with — B are equal, 

V[{Y t ,X u B}}=V[{Y t ,~Xu-B}] (15) 

where V[] denotes respective probability of a trajectory. 
We call the above equation as the microscopic reversibil- 
ity (MR) condition hereafter. As a special case, when 
B = 0, the above condition can be written simply as 

V[{Y t ,X t }]=V[{Y t ,X t }]- (16) 

We define WF[{Y t , At, B}] as work performed along 
a trajectory {Y t ,A t ,i?} where Wf = [E(Y T ,X T ) — 
E(Y--r, Ao)], the difference in total energy of the final 
and initial point of the trajectory. For a forward proto- 
col {At}, we define the probability distribution of work 
W, as P{W; {At}, B) = Pf(W) which can be written as 

P F (W) = Pst(Y- T Ao,Bo)V{{Y t ,X t ,B}} 

{Y t } 

x6(W F -W), (17) 

where P s t(Y_7-, Ao, B) is the initial steady state distribu- 
tion at time t = —T, and V\{Y t , At, B}) is the probability 
of the trajectory {Y t ,At,i?}. For the reverse protocol 
{At} with reversed magnetic field — B, the probability 
distribution P(W; {A_J, —B) = P R (W) of work W can 
be written as 

Pr(W) = 5] P st (Y T ,X T ,-B T )r[{Y,X,-B}} 

{Y t } 

xS{W R -W), (18) 

where work performed along the trajectory {Y t , A t , —B} 
is W R = [£(Y_ r , A ) - E(Y T , A T )]. 

Throughout the paper, we use two symmetry relations 
as following. 

(1) W F [{Y U At, B}] = -W R [{Y U At, -B}}, i.e., the work 
performed is odd under simultaneous reversal of time and 
the magnetic field. 

(2) P st (Y, X, B) = P st {Y, X) - P st (Y, A), i.e., the steady 
state distribution is independent of the magnetic field 
and invariant when velocities arc reversed. 

To show the symmetry relation 1, one should note that 
work done along a trajectory is, by definition, the differ- 
ence in total energy of the CS at the final and the initial 
point of the trajectory, implying Wf = [E(Yf,X T ) — 
£(Y_ r ,A )] and Wr_= [£(Y_ r , A )-£(Y r , A T )]. Now 
using E(Y, A) = E(Y,X), i.e., energy is invariant when 
velocities are reversed, one obtains the symmetry relation 
1. The symmetry relation 2 holds because the steady 
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state distribution of the CS is uniform on a constant en- 
ergy surface where energy of the CS is independent of 
the magnetic field and the uniform steady state distri- 
bution does not change for the reversed velocities. In- 
dependence of the total energy on the magnetic field has 
already been manifested in Eq. [5]where energy of a deter- 
ministic system has been expressed in terms of positions 
and velocities [41 1. 

Using microscopic reversibility condition of Eq. I15l and 
the symmetry relation 2, changing summation indices 
{Y t } — > {Y t }, and then using the symmetry relation 
1, Eq. [17] can be rewritten as 

{Yt} 

xV[{Y u \ t ,-B}]6(W R + W). (19) 

Now defining entropy and temperature of the CS, 
as done before in the case of Newtonian dynam- 
ics in section II, one can write the probabilities 
of the initial and final microstates respectively as 
P st (Y_ r ,A ) = e ^^) e WAo) and P st (Y r ,X T ) = 
e -s B (E- T ) e -l3W Fe 0F(\ T ) w } iere g B en t r opy of the heat 
bath and F(X) the Hclmholtz free energy of the system 
with the external parameter A. So the ratio of the prob- 
abilities can be written as 



P st (Y„ r ,A ) 
Pst (Yj- , A T ) 



/3(Wf-AF) 



(20) 



where AF = F(X r ) — F(Xq) the difference in the 
Helmholtz free energy. Substituting the above ratio of 
probabilities into Eq. Q1J1 one arrives at the Crooks the- 
orem in the presence of an external magnetic field, 



P(W;{X t },B) 
P(-W;{X t },-B) 



,0(W-AF) 



(21) 



where the probability distributions of work in gen- 
eral depend on the magnetic field B as the transition 
probabilities depend on B. The Jarzynski equality, 
(exp(— /3W)) = exp(— (3AF), is derived straightforwardly 
by integrating the Crooks theorem [TtJ • Note that Eq. [2T] 
relates the probability distributions of work for two sys- 
tems with different microscopic dynamics, i.e., one sys- 
tem with a magnetic field B and the other with a mag- 
netic field —B. Importantly, unlike the Crooks theorem, 
the Jarzynski equality is written without any reference 
to the magnetic field and so the Jarzynski equality is a 
statement regarding a system with a particular dynam- 
ics. 

The Crooks theorem takes an interesting form, if ge- 
ometry of a system is symmetric with respect to the mag- 
netic field B. Given this symmetry, the work probability 
distributions do not depend on the direction of P, but 
depend only on the magnitude \B\: P(W;{Xt},B) = 



P(W;{X t },-B) = P(W;{X t },\B\) (similarly for the 
work probability distribution with reverse protocol {At}). 
This implies that, in this case, the Crooks theorem holds 
even when the magnetic field is same for the forward 
and the reverse protocol. Replacing the index — B by 
B in Eq. [2TJ one can now write the Crooks theorem 
as P(W;{X t },B)/P(-W;{X t },B) = exp[ft(W - AF)]. 
Note that in this case one does not have to reverse the 
direction of the magnetic field in the reverse protocol, 
and therefore the Crooks theorem expresses symmetries 
in the probability distributions of work for a system with 
same dynamics for the forward and the reverse proto- 
col. This type of symmetry would be illustrated in an 
example given in section IV. A. 



STOCHASTIC DYNAMICS: ILLUSTRATION 

In this section, we illustrate the ideas developed in the 
previous section by constructing two simple stochastic 
models. First we consider the effect of an external mag- 
netic field where, to ensure violation of detailed balance, 
we specifically choose reverse transition probability to be 
zero for any nonzero forward transition probability. Sec- 
ond we consider a nonconscrvative force in a stochastic 
set up. Although the two models considered in this sec- 
tion are just toy models for a system and a heat bath, 
they nevertheless demonstrate the dissipative and equi- 
librating mechanism of a heat bath, and subsequently 
show the validity of the Crooks theorem even when the 
heat bath goes out of equilibrium during driving. 

Time-reversal symmetry-breaking field 

We take a one dimensional ring of L + 1 sites where 
site i = is considered as the system and all other sites, 
1 < i < L, are considered to be the heat bath (see Fig. 
[2]). At any site i there is an energy variable e\ > 0. 
The energy at site i = is given by eo = Xx where 
the external parameter A couples only to the system via 
an internal degree of freedom x > 0. A configuration 
of the CS is thus specified by Y = {x, ei, . . . , e^}. The 
dynamics is the following: a site i is chosen randomly and 
a fixed amount of energy S (<C 1) is transferred only in 
one direction (say, anti-clockwise) to the nearest neighbor 
site, i.e., 



"i+l 



(22) 



The total energy E = Yli=o e * * s conserved in this pro- 
cess. Whenever energy eo at i = is changed, the vari- 
able x is updated accordingly: eo — > e' Q => x — > x' = 
e' /X. For e^ < 5, the energy transfer is not allowed. 

There is a mean energy current in anti-clockwise di- 
rection which may be considered to be due to an exter- 
nally applied field in this direction (analogous to B) . The 



FIG. 2: Schematic diagram of the system and the heat bath. 
The system is the site i = 0, and rest of the sites, 1 < i < L, 
constitute the heat bath. 



reverse field corresponds to the dynamics where energy 
is transferred in clockwise direction (analogous to —B). 
Since there are no velocity-like variables, we have Y = Y 
and time-reversal is simply defined as Y(i) — > Y(— t) as 
t —> —t in a symmetric time interval ~T <t<T. Note 
that, in this case, reverse transition probability is zero for 
any nonzero forward transition probability because en- 
ergy is transferred only in one direction (anti-clockwise) , 
i.e., w(Y\Y';B) = for any nonzero w(Y'\Y;B) ^ 0. 
Therefore a time reversed trajectory is possible only for 
the dynamics where energy is transferred in the reverse 
direction (i.e., clockwise). Clearly, the model satisfies the 
microscopic reversibility w(Y'\Y; B) = io(Y|Y'; — B) as 
given in Eq. [14] (with Y = Y), and also satisfies the 
symmetry relations 1 and 2. 

When A is kept constant, total energy E is conserved 
and the dynamics is a totally asymmetric zero range pro- 
cess [42| on a ring with a constant hopping rate where 
number of particles at a site is ti/8. With total number 
of particles fixed in the process, steady state configura- 
tions are all equally probable. This can be understood by 
mapping the zero range pro cess to a totally asymmetric 
simple exclusion process [42j where all possible states are 
equally probable in the steady state. In the limit of large 
L, probability distribution of energy at any site i is given 
by the Boltzmann distribution, P{e{) = fie~^ ei where 

f3 = [J2i=o e i/(-k + l)] -1 i s inverse temperature of the CS. 
The partition function of the system, for a fixed value of 
A, can be calculated as Z(X) = J °° e~^ Xx dx = (/3A) _1 
and the free energy is given by F(A) = — j3~ l InZ. 

The system is driven by changing the external parame- 
ter, in discrete step of SX t at t-th time step, from an initial 
value Ao to a final value A T in time interval < t < r. For 
each increment 5 At , an amount of energy 5Wt is added 
to the system (i = 0) where SWt = (deo/dX)SX t = x.SXt 
is defined as work performed at t-th time step. Total 
work performed is W = J2t <Wt- We set a unit of time 
such that all sites are updated with rate one per unit 
Monte Carlo time. For the reverse protocol, the exter- 
nal parameter is varied as X(t) = A(r — t) in time in- 
terval < t < t, from A r to Ao. Note that energy is 
always transferred in anti-clockwisc direction both for 
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FIG. 3: The ratio Pf(W)/Pr(-W) is plotted versus work W 
in semi-Log scale and fitted with exp[/3(W — AF)] for L = 100, 
P = 1.0, Ao = 1.0, A T = 11.0 where r = 100 and AF = 
(l//?)ln(A T /A ). 



the forward and the reverse protocol. The probability 
distributions of work W for the forward and the re- 
verse protocol are denoted as P(W; A) = Pp{W) and 
P(W; A) = Pr(W) respectively. Due to symmctriy of 
the ring geometry, the work distributions do not depend 
on the direction of the energy transfer. We verify nu- 
merically that the Crooks theorem is indeed satisfied, 
i.e., P F (W)/P R (-W) = exp[/3(VF - AF)] with AF = 
F(X T ) - F(Ao). In Fig. 1 we plot P F {W)/P B {-W) as 
a function of W where Ao = 1.0, A r = 11.0, t = 100, 
13 = 1.0, L = 100. The parameter A is increased in a 
specific way: first A is increased in 5 equal discrete steps 
upto t = 5, then held constant upto t = 95, and again 
increased in 5 equal discrete steps upto t = 100. The pa- 
rameter A is varied in this particular way to ensure that 
the energy fluctuations travel around the ring and can 
perturb the system at site i = within the measurement 
time t = 100. In Fig. [3J the ratio P F (W)/P R {-W) fits 
well with exp[^(VF - AF)] where AF = (1//3) ln(A r /A ) 
is the theoretical of the difference in free energy. 

Nonconservative force 

When a nonconservative force is present in the CS, e.g., 
a system of particles in a ring in contact with a heat bath 
and with a force acting in anti-clockwisc direction as in 
Fig. [TJ the force field cannot be derived from the gradient 
of a scalar potential and therefore cannot be absorbed in 
the expression of the total energy of the CS (e.g., see Eq. 
[5|. In this case, unlike changing an external parameter 
A, the system is driven by changing Y — > Y + SY as 
discussed in section III. To illustrate this, we consider a 
CS which consists of L + 1 lattice sites in one dimension. 
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The site i = has energy en = p 2 , with an internal 
variable p, and any other site i has energy > 0. The 
site i = is considered to be the system and the rest 
is the heat bath. A configuration of the CS is specified 
by Y = {p, e±, . . . , e^} where, for any given Y, there is a 
Y = {— p, e%, . . . , ez}- The dynamics is chosen as follows. 
For 1 < i < L we choose a site at random and exchange 
energy between sites i and i + 1 randomly, 



ei -> q(ei + e i+ i); e 



i+l 



(l- g )( ei + e i+1 ), (23) 



where g G [0, 1] is a uniform random number. The total 
energy E = Yli=a ^ s cons tant in this process. We update 
the site i = slightly differently where we consider that 
the site i = can interchange energy only with site i = 1 . 
Say, energy of the two sites, before update, are en = p 2 
and ei respectively. Wc generate a random number £ 
uniformly distributed in the range \—pm,ax-,Pmax\ where 
Pmax = V e o + We then update the internal variable 
p and energy of the site i = 0, 1 as given below, 



e ^£ 2 ; ei -> (e + e x -£ 2 ). 



(24) 



The update rule ensures that detailed balance is satis- 
fied with respect to a uniform measure on a constant 
energy surface of the CS. Consequently, while the CS 
is not driven, the site i = has the Boltzmann prob- 
ability distribution P(p) = cxp(— f3p 2 )/Z where /3 = 

Ei=o e i/{L + I)] 1 i s inverse temperature of the CS and 
Z = dp exp(— (3p 2 ) is the partition function. 

The system is driven by changing the internal variable 
p as follows: p —> p + S where S > is a constant (choice 
of the sign of 6 is arbitrary). Now two following steps per- 
formed repeatedly: Step.l - random sequential update of 
L bonds of the CS using Eq. [531[M]and Step. 2 - update 
of the site i = by changing the internal variable from 
p to p + S. The second step may be thought of, as if the 
internal variable p is like momentum of a particle and 
it is updated due to effect of an external constant non- 
conservative force / which changes p by a fixed amount 
S = f.dt in a small time interval dt. Note that, under the 
driving, the transition p — » p + 5 (also — (p + S) — > —p) 
is allowed, but the transition p + S — > p is not allowed. 
In other words, internal variable p only changes in one 
direction, i.e., either increases (for S > 0) or decreases 
(for 5 < 0), under the driving. Work SW t done on the 
system is the change in energy of the system (i.e., site 



5(2p + 5) and total 



z = 0) where 5W t = (jp + 5) ~ P 

work W = J2t Sw t- 

The dynamics considered above is similar to the 
Langevin dynamics of a Brownian particle in a thermal 
environment where an external nonconservative force is 
acting on the particle. One should note that, given a 
trajectory [p(t), {ei(t)}], one can define time-reversal op- 
eration in two ways, i.e., as t -> —t, [p(t),{ei(t)}] — > 
[-p(-t),{ei(-t)}] or ]p(t),{ei(t)}] -> \p(-t), {e<(-t)}]. 
But only the first way of time-reversal is relevant here 



because, given a trajectory \p(t), {ei{t)}], the trajectory 
\p(—t), {ej(— t)}] is not realizable as p only increases un- 
der the driving. However the microscopic reversibility 
condition in Eq. [16] is satisfied as the transition probabil- 
ities have an additional symmetry, w(p', {e/}|p, {&;}) = 
w(-p,{ei}\ -P',K}), i.e., w(Y'\Y) = w(Y\Y'). 

Following the general proof given in section III, 
one can see that the Crooks theorem is satisfied, 
P(W)/P(— W) = exrj((3W), where the free energy 
change AF = 0. Since the forward and reverse proto- 
col of driving is same in the above example, we have 
used P F {W) = P R {W) = P(W) in the Crooks theorem. 
For a time-dependent external nonconservative force, the 
increment St of the internal variable p at a time step t 
will be St = ft-dt, where ft is the force at time step t. 
In this case, the reverse protocol should be {/_*} for a 
given forward protocol {ft}, and one should distinguish 
between the work probability distributions Pp(W) and 
Pr(W). Then the Crooks theorem can be written in the 
more general form as Pf(W)/Pr(— W) = exp(/3W). 



GENERALIZATION 

The fluctuation theorems can be generalized to the 
cases where a system is in contact with a heat bath with 
pressure P and (or) chemical potential (i. Let us consider 
the combined system with total energy E, volume V and 
number of particles N which arc globally conserved. En- 
ergy, volume and number of particles e, v and n of the 
system fluctuate due to interaction with the heat bath. 
Pressure P and chemical potential [i can be defined, sim- 
ilar to temperature, as given below, 



pP = 



dS B (E,V,N) 
dV 

dS B (E,V,N) 
ON 



(25) 
(26) 



Now using the expansion of the heat bath entropy Sb(E— 
e, V - v, N - n) = S B (E, V, N) - /3e - /3Pv - fan in the 
limit of e <C E, v -C V and n -C N, one can rewrite the 
ratio of the probabilities of microstates at t = ±T, as 
given in Eq. [20l as 



P st (Y_ r ,A ) 
P st (Y r ,A T ) 



D /3(WF[{Y t ,A t ,B t }]-Aa) 



(27) 



where G(P, P, (J., A) the grand potential of the system in 
equilibrium with a heat bath of inverse temperature /?, 
pressure P and chemical potential /i, A an external pa- 
rameter and AC? = Q(X T ) — <7(Ao) with the grand poten- 
tial Q defined as 



> 



de I dV I dne -P(*+P*+»n) e S(e,v, ni \) 

(28) 
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where S(e, v, n, A) is entropy of the system. Then the 
Crooks theorem can be written as given below, 

P(W;\(t),B(t)) 
P(-W;X(-t),-B(-t)) 

which is obtained by replacing the Helmholtz free energy 
F in Eq. [21] by the grand potential Q. 

SUMMARY 

In this paper, we have studied the fluctuation theo- 
rems for a classical system in contact with a heat bath in 
the presence of a time-reversal symmetry-breaking field 
and nonconservative forces, in a deterministic as well as 
a stochastic set up. We have shown that the fluctua- 
tion theorems are valid under the condition that, in the 
absence of any driving, the system and the heat bath, 
combined, relax to a state having a uniform probability 
measure on a constant energy surface. The fluctuation 
theorems have been proved in a very general setting by 
using the time-reversal symmetry and the conservation 
laws, and accordingly defining the intensive thermody- 
namic variables like temperature, pressure, chemical po- 
tential obtained from a microcanonical ensemble. In the 
deterministic case of Newtonian dynamics, we have first 
shown that Liouville's theorem holds even in the presence 
of a time-dependent external magnetic field and other 
time-dependent nonconservative forces and then, using 
Liouville's theorem, we have proved the Crooks Theorem 
and the Jarzynski equality in the presence of such forces. 
In the stochastic case, where the combined system obeys 
Markovian dynamics, the work fluctuation theorems have 
been shown to be valid even when the reverse transition 
probabilities are not equal to the corresponding forward 
transition probabilities, thus violating detailed balance 
condition. 

ACKNOWLEDGMENTS 

The author thanks J. Robert Dorfman, Dov Levine and 
Yariv Kafri for many useful discussions and acknowledges 
a fellowship of the Israel Council for Higher Education. 




FIG. 4: (Color online) Schematic diagram of a network in 
a configuration space: Configurations are denoted as nodes 
Ci, C2, C3, . . . Cs- Nodes are connected by various closed 
loops, each of which is assigned a transition rate. Transition 
rates assigned to the dotted arrows should be added to get 
the corresponding total transition rate. 




FIG. 5: Network with the magnetic field B: Transition rates 
assigned to the dotted arrows in Fig. U are added to get the 
actual transition rate (denoted by the thick arrows in this 
figure). Transition rates in general depend on the magnetic 
field. 



APPENDIX 

For an equilibrium system, detailed balance with re- 
spect to a uniform (microcanonical) probability measure 
is a sufficient condition for all states to be equally prob- 
able in the final equilibrium state. Here we formulate 
a sufficient condition for having equally probable steady 
states for a noncquilibrium system with finite number of 
states. 



Although we now specifically consider the case where 
all reverse transition rates to be zero for corresponding 
nonzero forward transition rates (similar to the exam- 
ple considered in section IV. A), the following discussion 
can be straightforwardly generalized to cases where a 
forward and corresponding reverse transition rate both 
may be nonzero. Also we only consider here the case 
where there is no velocity-like variables, however the gen- 
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eralization to such cases is straightforward. In Fig. [4j 
a network in a configuration space is shown schemati- 
cally. A configuration C is denoted by a node in the 
graph. Nodes are connected by drawing closed loops, 
where each loop is assigned a transition rate, e.g., see 
Fig. 3] where loops are assigned transition rates W\, 
u>2, u>3, etc. If two configurations are connected by 
more than one loop, each assigned with different tran- 
sition rates, the total transition rate from one configura- 
tion to another is given by sum of the transition rates. 
For example, in Fig 2J the total transition rate from 
C% to C\ is w(C\\C 2 ) = (w\ + w 2 + w 3 ). Similarly, 
w(C 3 \Ci) = (wi + w 2 ), w(C 5 \C 7 ) = (w 4 + w 5 + iu 6 ), 
etc. The resulting network is shown in Fig. [5j We call 
this way of assigning a transition rate (or transition prob- 
ability) to a closed loop of configurations in a graph as 
loopwise balance. Only constraint for drawing such loops 
is that all nodes must be connected to each other along 
some path so that the system is ergodic. Apart from this, 
loops are otherwise drawn arbitrarily. Note that since 
the Markov process is ergodic, it has a unique steady 
state solution. There are several ways to connect nodes 
satisfying the constraint of having uniform steady state 
measure and, since the Markov process is ergodic, all con- 
figurations always have equal steady state probabilities. 
To see this, consider the Master equation for the Markov 
process defined on a network in Fig. |H 



dP(d 
dt 



-(wi + w 2 + w 3 + w 6 )P(Ci) 



+(wi +w 2 + w 3 )P(C 2 ) + w 6 P(C 5 ), 

^pl = -( Wl+W2 +w 3 )P(C 2 ) 
at 

+ Wl P(C 3 ) + w 2 P{C 8 ) + w 3 P(C 4 ) 7 




c, 



w 5 +w 6 



FIG. 6: Network with the reverse magnetic field —B: Reversal 
of the direction of the magnetic field B corresponds to reversal 
of all transition rates, i.e., interchanging forward and reverse 
transition rate. The network for the reverse magnetic field 
— B results from the network of Fig. [S] by reversing all the 
arrows. 



direction, i.e., just by reversing the arrows on a network 
as done in Fig. [S] Note that the transition rates as- 
signed to loops in general depend on the magnetic field. 
However the steady state distribution remains uniform 
and thus independent of the magnetic field, which is the 
symmetry relation 2 considered in section III. Note that, 
although the Master equation changes under reversal of 
the magnetic field, the steady state solution is still un- 
changed, i.e., all steady states are still equally probable. 



dP(C 7 ) 



dt 



-(w 5 
dP(C 8 
dt 



~(w i + w 5 +w e )P(C 7 ) 
we)P(C i ) + w^P(C s ), 

-{w 2 +w 4 )P(C 8 ) 
+(w 2 +w 4 )P(C 3 ). 



(30) 



From above set of equations it is clear that all steady 
states have equal probabilities, i.e., P(C\) = P{C 2 ) — 
P{C 3 ) = ■ ■ ■ = P(Cs) = constant is the steady state 
solution of the Master equation. Since the network is 
ergodic, the steady state is also unique. Therefore loop- 
wise balance is a sufficient condition for having a uniform 
steady state measure in an ergodic Markov process with 
finite number of states. 

If the Markov process, as defined on the network in Fig. 
is considered to be in the presence of a magnetic field 
B, then the Markov process with the reverse magnetic 
field — i? is defined on the same network by assigning 
transition rates from one node to another in the reverse 
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